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£N1 . Abstract 

We consider the problem of constructing explicit Hitting sets for Combinatorial Shapes, a 



class of statistical tests first studied by Gopalan, Meka, Reingold, and Zuckerman (STOC 2011). 
These generalize many well-studied classes of tests, including symmetric functions and combi- 
" natorial rectangles. Generalizing results of Linial, Luby, Saks, and Zuckerman (Combinatorica 

1997) and Rabani and Shpilka (SICOMP 2010), we construct hitting sets for Combinatorial 
Shapes of size polynomial in the alphabet, dimension, and the inverse of the error parame- 
ter. This is optimal up to polynomial factors. The best previous hitting sets came from the 
Pseudorandom Generator construction of Gopalan et al., and in particular had size that was 
quasipolynomial in the inverse of the error parameter. 



Our construction builds on natural variants of the constructions of Linial et al. and Rabani 
and Shpilka. In the process, we construct fractional perfect hash families and hitting sets for 
combinatorial rectangles with stronger guarantees. These might be of independent interest. 

>: 

^ ; 1 Introduction 

Randomness is a tool of great importance in Computer Science and combinatorics. The probabilistic 
method is highly effective both in the design of simple and efficient algorithms and in demonstrating 
the existence of combinatorial objects with interesting properties. But the use of randomness also 
comes with some disadvantages. In the setting of algorithms, introducing randomness adds to the 
number of resource requirements of the algorithm, since truly random bits are hard to come by. 
For combinatorial constructions, 'explicit' versions of these objects often turn out to have more 
structure, which yields advantages beyond the mere fact of their existence (e.g., we know of explicit 
error-correcting codes that can be efficiently encoded and decoded, but we don't know if random 
codes can [5]). Thus, it makes sense to ask exactly how powerful probabilistic algorithms and 
arguments are. Can they be 'derandomized', i.e., replaced by determinstic algorithms/arguments 
of comparable efficiency? 1 There is a long line of research that has addressed this question in 
various forms [19, 11, 18, 23, 16]. 

An important line of research into this subject is the question of derandomizing randomized 
space-bounded algorithms. In 1979, Aleliunas et al. [1] demonstrated the power of these algorithms 
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by showing that undirected s-t connectivity can be solved by randomized algorithms in just 0(log n) 
space. In order to show that any randomized logspace computation could be derandomized within 
the same space requirements, researchers considered the problem of constructing an efficient e- 
Pseudorandom Generator (e-PRG) that would stretch a short random seed to a long pseudorandom 
string that would be indistinguishable (up to error e) to any logspace algorithm. 2 In particular, 
an e-PRG (for small constant e > 0) with seedlength O(logn) would allow efficient deterministic 
simulations of logspace randomized algorithms since a deterministic algorithm could run over all 
possible random seeds. 

A breakthrough work of Nisan [18] took a massive step towards this goal by giving an explicit e- 
PRG for e = l/poly(n) that stretches 0(log 2 n) truly random bits to an n-bit pseudorandom string 
for logspace computations. In the two decades since, however, Nisan's result has not been improved 
upon at this level of generality. However, many interesting subcases of this class of functions have 
been considered as avenues for progress [20, 12, 14, 13, 15]. 

The class of functions we consider are the very natural class of Combinatorial Shapes. A boolean 
function / is a combinatorial shape if it takes n inputs x\,...,x n 6 [m] and computes a symmetric 
function of boolean bits yi that depend on the membership of the inputs X{ in sets Ai C [m] 
associated with /. (A function of boolean bits y±, . . . ,y n is symmetric if its output depends only 
on their sum.) In particular, ANDs, ORs, Modular sums and Majorities of subsets of the input 
alphabet all belong to this class. Until recently, Nisan's result gave the best known seedlength for 
any explicit e-PRG for this class, even when e was a constant. In 2011, however, Gopalan et al. 
[9] gave an explicit e-PRG for this class with seedlength 0(\og(mn) + log 2 (l/e)). This seedlength 
is optimal as a function of m and n but suboptimal as a function of e, and for the very interesting 
case of e = l/n ^, this result does not improve upon Nisan's work. 

Is the setting of small error important? We think the answer is yes, for many reasons. The 
first deals with the class of combinatorial shapes: many tests from this class accept a random 
input only with inverse polynomial probability (e.g., the alphabet is {0, 1} and the test accepts iff 
the Hamming weight of its n input bits is n/2); for such tests, the guarantee that a l/n°( 1 ^-PRG 
gives us is unsatisfactory. Secondly, while designing PRGs for some class of statistical tests with 
(say) constant error, it often is the case that one needs PRGs with much smaller error — e.g., 
one natural way of constructing almost-log n wise independent spaces uses PRGs that fool parity 
tests [17] to within inverse polynomial error. Thirdly, the reason to improve the dependence on the 
error is simply because we know that such PRGs exist. Indeed, a randomly chosen function that 
expands O(logn) bits to an n-bit string is, w.h.p., an e-PRG for e = l/poly(n). Derandomizing this 
existence proof is a basic challenge in understanding how to eliminate randomness from existence 
proofs. The tools we gain in solving this problem might help us in solving others of a similar flavor. 

Our result. While we are unable to obtain optimal PRGs for the class of combinatorial shapes, 
we make progress on a well-studied weakening of this problem: the construction of an e -Hitting 
Set (e-HS). An e-HS for the class of combinatorial shapes has the property that any combinatorial 
shape that accepts at least an e fraction of truly random strings accepts at least one of the strings 
in the hitting set. This is clearly a weaker guarantee than what an e-PRG gives us. Nevertheless, in 
many cases, this problem turns out to be very interesting and non-trivial: in particular, an e-HS for 
the class of space-bounded computations would solve the long-standing open question of whether 
RL = L. Our main result is an explicit e-HS of size poly (mn/e) for the class of combinatorial 

As a function of its random bits, the logspace algorithm is read-once: it scans its input once from left to right. 
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shapes, which is optimal, to within polynomial factors, for all errors. 

Theorem 1.1 (Main Result (informal)). For any ra,n6ff,£>0, there is an explicit e-HS for the 
class of combinatorial shapes of size poly(mn/e). 

Related work: There has been a substantial amount of research into both PRGs and hitting sets 
for many interesting subclasses of the class of combinatorial shapes, and also some generalizations. 
Naor and Naor [17] constructed PRGs for parity tests of bits (alphabet size 2); these results were 
extended by Lovett, Reingold, Trevisan, and Vadhan [13] and Meka and Zuckerman [15] to modular 
sums (with coefficients). Combinatorial rectangles, another subclass of combinatorial shapes, have 
also been the subject of much attention. A series of works [6, 4, 14] have constructed e-PRGs for 
this class of functions: the best such PRG, due to Lu [14], has seedlength 0(logn + log 3 ^ 2 (l/e)). 
Linial, Luby, Saks, and Zuckerman [12] constructed optimal hitting sets for this class of tests. We 
build on many ideas from this work. 

We also mention two more recent results that are very pertinent to our work. The first is 
to do with Linear Threshold functions which are weighted generalizations of threshold symmetric 
functions of input bits. For this class, Rabani and Shpilka [21] construct an explicit e-HS of optimal 
size poly(n/e). They use a bucketing and expander walk construction to build their hitting set. 
Our construction uses similar ideas. 

The final result that we use is the PRG for combinatorial shapes by Gopalan et al. [9] that was 
mentioned in the introduction. This work directly motivates our results and moreover, we use their 
PRG as a black-box within our construction. 

2 Notation and Preliminaries 

Definition 2.1 (Combinatorial Shapes, Rectangles, Thresholds). A function f is an (m,n)- 
Combinatorial Shape if there exist sets Ax,... ,A n C [m] and a symmetric function h : {0, l} n — > 
{0,1} such that f(x\, . . . , x n ) = Ji(1a 1 (#i), • • • , ^-A„{x n )). 3 If h is the AND function, we call f 
an (m, n)-Combinatorial Rectangle. If h is an unweighted threshold function (i.e. h accepts iff 
^2i^Ai( x i) > 6 f or some 9 £ N), then f is said to be an {m, n)-Combinatorial Threshold. We 
denote by CShape(m, n), CRect(m,n), and CThr(m, n) the class of (m,n)- Combinatorial Shapes, 
Rectangles, and Thresholds respectively. 

Notation. In many arguments, we will work with a fixed collection of accepting sets A\, . . . , A n C 
[m] that will be clear from the context. In such a scenario, for i £ [n], we let Xi = l^^Xj), 
Pi = \Ai\/m, qi = 1 — pi and Wi = Piqi. Define the weight of a shape / as w(f) = ^ Wi. For 6 e N, 
let Tq (resp. T^) be the function that accepts iff Yl ^Ai(Xi) is at most (resp. at least) 6. 

Definition 2.2 (Pseudorandom Generators and Hitting Sets). Let T C {0,1}^* denote a boolean 
function family for some input domain D. A function G : {0, 1} S —> D is an e-pseudorandom 
generator (e-PRG) with seedlength s for a class of functions J- if for all f € T , 

| P [f(G(x)) = l]- ¥ [f(y) = l]\<e. 
i} s ye u D 

3 1 a is the indicator function of the set A. 
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An e-hitting set (e-HS) for T is a multiset H containing only elements from D s.t. for any f G T , 
ifF xeuD [f(x) = 1] > e, then 3x e H s.t. f{x) = 1. 

Remark 2.3. Whenever we say that there exist explicit families of combinatorial objects of some 
kind, we mean that the object can be constructed by a deterministic algorithm in time polynomial 
in the description of the object. 

We will need the following previous results in our constructions. 

Theorem 2.4 (e-PRGs for CShape(m, n) [9]). For every e > 0, there exists an explicit e-PRG 
Qqmrz '■ 1} S ~~ y t m ] n f or CShape(m, n) with seed-length s = 0(log(mn) + log 2 (l/e)). 

Theorem 2.5 (e-HS for CRect(m,ra) [12]). For every e > 0, there exists an explicit e-hitting set 
^llsz f or CRect(m, n) of size poly(m(logn)/e). 

We will also need a stronger version of Theorem 2.5 for special cases of combinatorial rectangles. 
Informally, the strengthening says that if the acceptance probability of a 'nice' rectangle is > p for 
some reasonably large p, then a close to p fraction of the strings in the hitting set are accepting. 
Formally, the following is proved later in the paper. 

Theorem 2.6 (Stronger HS for CRect(m,n)). For all constants c > 1, m = n c , and p < clogn, 
there is an explicit set S^f of size n° c ^ s.t. for any TZ G CRect(m,n) which satisfies the proper- 
ties: 

1. TZ is defined by A,- L , and the rejecting probabilities qi := (1 — |j4j|/m) which satisfy ^^qi < p, 

2. F x ^ m]n [K(X) = l}>p(> l/n c ) 
we have 

red 

Recall that a distribution p over [m] n is fc-wise independent for k € N if for any S C [n] s.t. 
\S\ < k, the marginal p\$ is uniform over [m]l s L Also, Q : {0, 1} S -> [m] n is a k-wise independent 
probability space over [m] n if for uniformly randomly chosen z £ {0, 1} S , the distribution of Q{z) is 
k-wise independent. 



Fact 2.7 (Explicit fc-wise independent spaces). For any k,m,n G N, there is an explicit k-wise 
independent probability space G™'™ ise '■ {0, 1} S —> [m] n with s = 0(klog(mn)). 

We will also use the following result of Even et al. [6]. 



Theorem 2.8. Fix any m,n,k £ N. Then, if f G CRect(m,n) and p is any k-wise independent 
distribution over \m] n , then we have 



P [/(*) = 1] - P [/(*) = 1] 



1 

< 



2 n(k) 
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Expanders. Recall that a degree- D multigraph G = (V, E) on N vertices is an (N, D, A)-expander 
if the second largest (in absolute value) eigenvalue of its normalized adjacency matrix is at most 
A. We will use explicit expanders as a basic building block. We refer the reader to the excellent 
survey of Hoory, Linial, and Wigderson [10] for various related results. 

Fact 2.9 (Explicit Expanders [10]). Given any A > and N G N, there is an explicit (N,D,X)- 
expander where D = (1/X)°^ . 

Expanders have found numerous applications in derandomization. A central theme in these 
applications is to analyze random walks on a sequence of expander graphs. Let G\ , . . . , Gj> be 
a sequence of (possibly different) graphs on the same vertex set V. Assume Gi (i G [£}) is an 
(N, Di, Aj)-expander. Fix any u G V and yi,...,yt G N s.t. yi G [£)»] for each i G [£]. Note that 
(u,yi,..., ye) naturally defines a 'walk' (t>i, . . . , Vf) G V e as follows: v\ is the yith neighbour of u in 
G\ and for each i > 1, Vi is the y^th neighbour of t> j_i in Gi. We denote by W(Gi, . . . , Ge) the set 
of all tuples (u,yi,. . . , ye) as defined above. Moreover, given w = (u,yi,..., ye) G W(G\, . . . , Ge), 
we define Vi(w) to be the vertex Vi defined above (we will simply use V{ if the walk w is clear from 
the context). 

We need a variant of a result due to Alon, Feige, Wigderson, and Zuckerman [2]. The lemma 
as it is stated below is slightly more general than the one given in [2] but it can be obtained by 
using essentially the same proof and setting the parameters appropriately. The proof is given in 
the appendix. 

Lemma 2.10. Let G\, . . . , Ge be a sequence of graphs defined on the same vertex set V of size N . 
Assume that Gi is an (iV, Di, \i)-expander. Let V±, . . . , Ve Q V s.t. |V£| > piN > for each i S [£]. 
Then, as long as for each i G [£], Aj < (piPi-i)/8, 

P Wie[£\Mv)eVA> (0.75)' l[ Pi . (l) 

Also, in our applications, we will sometimes use the following corollary. 

Corollary 2.11. Let V be a set of N elements, and let < pi < 1 for 1 < i < s be given. There 
exists an explicit set of walks W, each of length s, s.t. for any subsets V±,V2, ■■■ ,V S of V, with 
\Vi\ > PiN, there exists a walk w = w\W2 ■ ■ ■ w s G W such that Wi G Vi for all i. Furthermore, there 
exist such W satisfying \W\ < poly^N, Yli-i ^r)- 

This follows from Lemma 2.10 by picking Aj smaller than piPi-i /10 for each i. By Fact 2.9, 
known explicit constructions of expanders require choosing degrees di = The number of 

walks of length s is N ■ JX_i di, which gives the bound on W above. 

Hashing. Hashing plays a vital role in all our constructions. Thus, we need explicit hash families 
which have several "good" properties. First, we state a lemma obtained by slightly extending part 
of a lemma due to Rabani and Shpilka [21], which itself builds on the work of Schmidt and Siegel 
[22] and Fredman, Komlos, and Szemeredi [8]. It is somewhat folklore and the proof is omitted. 

Lemma 2.12 (Perfect Hash Families). For anyn,t G N, there is an explicit family of hash functions 
Wyerf ^ [A^ °f s ^ ze 2°^poly(n) s.t. for any S C [n] with \S\ = t, we have 

P [h is 1-1 on S] > — TTT-r- . 
he«»-* " 2°(*) 

perf 
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The family of functions thus constructed are called "perfect hash families". We also need a 
fractional version of the above lemma, whose proof is similar to that of the perfect hashing lemma 
and is presented later in the paper. 



Lemma 2.13 (Fractional Perfect Hash families). For any n,i E! N, there is an explicit family of 



hash functions 'hCf* ac Q [t]^ of size 2°^n°^ s.t. for any z G [0, 1]" with X^efn] z 3 — we have 



where M = ^ e |"' Zj . 

3 Outline of the Construction 

We will outline some simplifying assumptions, and an observation which "reduces" constructing hit- 
ting sets for Combinatorial shapes CShape(m, n) to those for Combinatorial Thresholds CThr(m, n). 
It turns out that these are somewhat simpler to construct, appealing to the recent results of Gopalan 
et al. [9]. 

We first make a standard simplifying observation that we can throughout assume that m, n, 1/e 
can be n olyl \ Thus, we only need to construct hitting sets of size in this case. From now on, 

we assume m, 1/e = n°^ l \ 

Lemma 3.1. Assume that for some c > 1, andm < n c , there is an explicit l/n°-HS for CShape(m, n) 
of size ra° c W . Then, for any m,n, G N and e > 0, there is an explicit e-HS for CShape(m,re) of 
size poly (mn/s). 

Proof. Fix c > 1 so that the assumptions of the lemma hold. Note that when m > n c , we can 
increase the number of coordinates to n' = m. Now, an e-HS for CShape(m, n') is also an e-HS for 
CShape(m, n), because we can ignore the final n' — n coordinates and this will not affect the hitting 
set property. Similarly, when e < l/n c , we can again increase the number of coordinates to n' that 
satisfies e > l/(n') c and the same argument follows. In each case, by assumption we have an e-HS 
of size {n') 0c ^ = poly(mn/e) and thus, the lemma follows. □ 

Next, we prove a crucial lemma which shows how to obtain hitting sets for CShape(m, n) starting 
with hitting sets for CThr(m, n). This reduction crucially uses the fact that CShape does only 
'symmetric' tests - it fails to hold, for instance, for natural "weighted" generalizations of CShape. 

Lemma 3.2. Suppose that for every e > 0, there exist an explicit e-HS for CThr(m, n) of size 
F(m,n, 1/e). Then there exists an explicit e-HS for CShape(m,n) of size (n+l)-F 2 (m,n, (n+l)/e). 

Proof. Suppose we can construct hitting sets for CThr(m, n) and parameter e' of size F(m, n, 1/e'), 
for all e' > 0. Now consider some / G CShape(m,n), defined using sets A\ and symmetric function 
h. Since h is symmetric, it depends only on the number of l's in its input. In particular, there is 
a W C [n] U {0} s.t. for a G {0, l} n we have h(a) = 1 iff \a\ G W. Now if F x [f (x) = 1] > e, there 
must exist a w G W s.t. 



P 



n,t 
' frac 




n\{ie[n] | l A .(x i ) = l}\ 



w] > 



\W\ ~ n + 1' 
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Thus if we consider functions in CThr(m,ra) denned by the same Ai, and thresholds T+ and T~ 
respectively, we have that both have accepting probability at least ej (n+1), and thus an ej (n+l)-HS 
S for CThr(m,n) must have 'accepting' elements y,z £ [m] n for T w and T+ respectively. 

The key idea is now the following. Suppose we started with the string y and moved to string z 
by nipping the coordinates one at a time - i.e., the sequence of strings would be: 

(yi 2/2 ■ ■ ■ Vn), (zi VI ■■■ Vn), Ol z 2 ■■■ y n ), ...,(z 1 z 2 ... z n ). 

In this sequence the number of "accepted" indices (i.e., i for which l^(xj) = 1) changes by 
at most one in each 'step'. To start with, since y was accepting for T~ , the number of accepting 
indices was at most w, and in the end, the number is at least w (since z is accepting for T+), and 
hence one of the strings must have precisely w accepting indices, and this string would be accepting 
for /! 

Thus, we can construct an e-HS for CShape(m, n) as follows. Let S denote an explicit (e/(n+l))- 
HS for CThr(m, n) of size F(m, n, 1/e). For any y,z S 5, let X v z be the set of n + 1 "interpolated" 
strings obtained above. Define S' = \J y ze s%y,z- As we have argued above, S' is an e-HS for 
CShape(m,n). It is easy to check that S' has the size claimed. □ 

Overview of the Constructions. In what follows, we focus on constructing hitting sets for 
CThr(m,n). We will describe the construction of two families of hitting sets: the first is for the 
"high weight" case - w(f) := Y2i w i > Clogn for some large constant C, and the second for the 
case w(f) < Clogn. The final hitting set is a union of the ones for the two cases. 

The high-weight case (Section 4.1) is conceptually simpler, and illustrates the important tools. 
A main tool in both cases is a "fractional" version of the perfect hashing lemma, which, though a 
consequence of folklore techniques, does not seem to be known in this generality (Lemma 2.13). 

The proof of the low- weight case is technically more involved, so we first present the solution 
in the special case when all the sets Ai are "small", i.e., we have pi < 1/2 for all i (Section 4.2). 
This case illustrates the main techniques we use for the general low-weight case. The special case 
uses the perfect hashing lemma (which appears, for instance in derandomization of "color coding" 
- a trick introduced in [3], which our proof in fact bears a resemblance to). 

The general case (Section 4.3), in which pi are arbitrary, is more technical: here we need to do 
a "two level" hashing. The top level is by dividing into buckets, and in each bucket we get the 
desired "advantage" using a generalization of hitting sets for combinatorial rectangles (which itself 
uses hashing: Theorem 2.6). 

Finally we describe the main tools used in our construction. The stronger hitting set construc- 
tion for special combinatorial rectangles is discussed in Section 5 and the fractional perfect hash 
family construction is discussed in Section 6. We end with some interesting open problems and a 
proof of the expander walk lemma follows in the appendix. 

4 Hitting sets for Combinatorial Thresholds 

As described above, we first consider the high-weight case (i.e., w(f) > Clogn for some large 
absolute constant C). Next, we consider the low- weight case, with an additional restriction that 
each of the accepting probabilities pi < 1/2. This serves as a good starting point to explain the 
genera/low-weight case, which we get to in Section 4.3. In each section, we outline our construction 
and then analyze it for a generic combinatorial threshold / : [m] n —> {0, 1} (subject to weight 
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constraints) defined using sets A\, . . . , A n C [m] . The theorem we finally prove in the section is as 
follows. 

Theorem 4.1. For any constant c > 1, i/ie following holds. Suppose m, 1/e < n c . For i/ie cZass 0/ 
functions CThr(m, n), i/iere exists an explicit s-hitting set of size n° c ^\ 

The main theorem, which we state below, follows directly from the statements of Theorem 4.1 
and Lemmas 3.1 and 3.2. 

Theorem 4.2. For any m, n £ N and e > 0, there is an explicit e-hitting set for CShape(m,n) of 
size poly (mn/e). 

4.1 High weight case 

In this section we will prove the following: 

Theorem 4.3. For any c > 1, there is a C > s.t. for m, 1/e < n c , there is an explicit e-HS of 
size n° c ^ for the class of functions in CThr(m,n) of weight at least Clogn. 

As discussed earlier, we wish to construct hitting sets for combinatorial shapes / where the 
associated symmetric function is either or Tq , for 6 s.t. the probability of the event for 
independent, perfectly random Xi is at least l/n c . For convenience, define \i := p\ + P2 + • • • + p n , 
and W := w\ + W2 + • • . w n . We have W > Clogn for a large constant C (it needs to be large 
compared to c, as seen below). First, we have the following by Chernoff bounds. 



Outline. Let us concentrate on hitting sets for combinatorial shapes that use symmetric functions 
of the form (the case Tq follows verbatim). The main idea is the following: we first divide 
the indices [n] into log n buckets using a hash function h (from a fractional perfect hash family, see 
Lemma 2.13). This is to ensure that the Wi get distributed somewhat uniformly. Second, we aim 



to obtain an advantage of roughly 2y j^^- in each of the buckets (advantage is w.r.t. the mean in 
each bucket): i.e., for each i £ [logn], we choose the indices Xj (j G h~ l (i)) s.t. we get 



with reasonable probability. Third, we ensure that the above happens for all buckets simultane- 
ously (with probability > 0) so that the advantages add up, giving a total advantage of 2yJcW log n 
over the mean, which is what we intended to obtain. In the second step (i.e., in each bucket), 
we can prove that the desired advantage occurs with constant probability for uniformly randomly 
and independently chosen Xj £ [m] and then derandomize this choice by the result of Gopalan et 
al. [9] (Theorem 2.4). Finally, in the third step, we cannot afford to use independent random bits 
in different buckets (this would result in a seed length of @(log 2 n)) - thus we need to use expander 
walks to save on randomness. 



Claim 4.4. IfP x [T+(£ ie[n] 1*0*)) = 1] > e (> l/n c ), we have 8<u + 2^cWlogn. 
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Construction and Analysis. Let us now describe the three steps in detail. We note that these 
steps parallel the results of Rabani and Shpilka [21]. 

The first step is straightforward: we pick a hash function from a perfect fractional hash family 
^frac gn - F rom Lemma 2.13, we obtain 



Claim 4.5. For every set of weights w, there exists an h G %jya° S " s -^- S or a ^ 1 — * — l°g n ; 



have 



lOOlogn - 2^jeh- 1 (i) W j — 



100W 



we 



The rest of the construction is done starting with each h G H™^ 11 . Thus for analysis, suppose 
that we are working with an h satisfying the inequality from the above claim. For the second step, 
we first prove that for independent random Xi G [to], we have a constant probability of getting an 

advantage of 2yJ over the mean in each bucket. 

Lemma 4.6. Let S be the sum of k independent random variables Xi, with PpQ = 1] = pi, let 
c' > be a constant, and let YliPi(^~Pi) — ° 2 > f or some a satisfying a > 20e c . Define fx := YliPi- 
Then ¥[S > [i + do] > a, and ¥[S < [i — e'er] > a, for some constant a depending on c' . 

The proof is straightforward, but it is instructive to note that in general, a random variable 
(in this case, S) need not deviate "much more" (in this case, a d factor more) than its standard 
deviation: we have to use the fact that S is the sum of independent r.v.s. This is done by an 
application of the Berry-Esseen theorem [7]. 



Proof. We recall the standard Berry-Esseen theorem [7]. 

Fact 4.7 (Berry-Esseen). Let Y\, . . . ,Y n be independent random variables satisfying \/i, EYi 
^Ey. 2 = a 2 and Vi, \Yi\ < f3o~. Then the following error bound holds for any t G K, 



0, 



>t] -F[N(0,a 2 ) >t) 



We can now apply this to Y{ := Xi —pi (so as to make EYj = 0). Then EY^ 2 = pi(l — pi) 2 + (1 — 
Pi)Pi = ~ Pi), thus the total variance is still > a 2 . Since \Yi\ < 1 for all i G [n], this means we 
have the condition |Yj| < /3<r for /3 < e _c /20. Now for the Gaussian, a computation shows that we 
have F[N(0,a 2 ) > c'a] > e~ c ' 2 /10. Thus from our bound on /3, we get P[£Yj > da] > e~ c ' 2 /20, 
which we pick to be a. This proves the lemma. □ 

Assume now that we choose x\, . . . , x n G [to] independently and uniformly at random. For each 
bucket i G [logn] defined by the hash function h, we let /ij = Yljeh- 1 ^) Pj an( ^ ^ = Yljeh- 1 ^) Pj(^~ 
Pj) = J2jeh- 1 (i) w j- Recall that Claim 4.5 assures us that for i G [logn], Wi > VF/lOOlogre > C/100. 
Let X® denote Y2jeh- 1 (i) ^-Aj{. x j)- Then, for any i G [logn], we have 



' cW 
log n 



> 



By Lemma 4.6, if C is a large enough constant so that W{ > C/100 > 20e , then for uniformly 
randomly chosen x\, . . . , x n G [to] and each bucket i G [log n], we have P LX"W >fH + 2^/cW/log n > 
a, where a > is some fixed constant depending on c. When this event occurs for every bucket, 
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we obtain Yljeln] ^-Aji^j) > fi + 2y/cW logn > fi + 6. We now show how to sample such an x £ [m] n 
with a small number of random bits. 

Let Q : {0, 1} S —> [m] n denote the PRG of Gopalan et al. [9] from Theorem 2.4 with parameters 
m,n, and error a/2 i.e. Gg'mrz '■ Note that since a is a constant depending on c, we have 
s = O c (logn). Moreover, since we know that the success probability with independent random Xj 
(j £ for obtaining the desired advantage is at least a, we have for any % £ [logn] and 

randomly chosen from {0, 1} S , 



X® > fH + 24 



/ cW 
logn 



> a/2 



This only requires seedlength O c (logn) per bucket. 

Thus we are left with the third step: here for each bucket i £ [logn], we would like to have 
(independent) seeds which generate the corresponding (and each of these PRGs has a seed 
length of O c (log n)). Since we cannot afford O c (log 2 n) total seed length, we instead do the following: 
consider the PRG Q defined above. As mentioned above, since a = Cl c (l), the seed length needed 
here is only O c (logn). Let S be the range of Q (viewed as a multiset of strings: S C [m]"). From 
the above, we have that for the ith bucket, the probability x ~ S exceeds the threshold on indices 
in bucket % is at least a/2. Now there are logn buckets, and in each bucket, the probability of 
'success' is at least a/2. We can thus appeal to the 'expander walk' lemma of Alon et al. [2] (see 
preliminaries, Lemma 2.10 and the corollary following it). 

This means the following: we consider an explicitly constructed expander on a graph with 
vertices being the elements of 5, and the degree being a constant depending on a). We then 
perform a random walk of length logn (the number of buckets). Let s\,S2, ■ ■ ■ , si ogn be the strings 
(from S) we see in the walk. We form a new string in [m} n by picking values for indices in bucket 
i, from the string S{. By the Lemma 2.10, with non-zero probability, this will succeed for all 
1 < i < logn, and this gives the desired advantage. 

The seed length for generating the walk is 0(log |<S|) + O c (l) - logn = O c (logn). Combining (or 
in some sense, composing) this with the hashing earlier completes the construction. 



4.2 Thresholds with small weight and small sized sets 

We now prove Theorem 4.1 for the case of thresholds / satisfying w(f) = O(logn). Also we 
will make the simplifying assumption (which we will get rid of in the next sub-section) that the 
underlying subsets of /, Ai, . . . ,A n C [m] are of small size. 

Theorem 4.8. Fix any c > 1. For dfiy tyi — tl c j there exists an explicit 1 j 'ti c -US ^i^ w % 

C [m] n of 

size n° c ^ for functions f £ CThr(m, n) s.t. w(f) < clogn and pi < 1/2 for each i £ [n]. 

We will prove this theorem in the rest of this sub-section. Note that since pi < 1/2 for each 
i £ [n], we have w\ = pi(l — pi) > Pi/2. 

To begin, we note that hitting sets for the case when the symmetric function is Tq is easily 
obtained. In particular, since Tq accepts iff ^ Xi = 0, it can also be interpreted as a combinatorial 
rectangle with accepting sets A±, . . . , A n . The probability of this event over uniformly chosen inputs 
is at least Yl^l — Pi) > e -2 ^ Pi > e~ i ^ iPi ^ Pi ^ > n~ 4c , where the first inequality uses the fact 
that (1 — x) > e~ 2x for x £ [0, 1/2]. Thus the existence of a hitting set for such / follows from the 
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result of Linial et al.. [12]. Further, by definition, a hitting set for Tq is also a hitting set for T 9 ~ 
for 9 > 0. We will therefore focus on hitting sets for thresholds of the form for some 9 > 0. 

Let us now fix a function f(x) = Tq(%2% 1a<(^»)) that accepts with good probability: ^ > x [T ( ^(^2 i ^.(xj)) = 
1] > e. Since w(f) < clogn and p, < 2wi for each i G [n], it follows that \i < 2c log n. Thus by a 
Chernoff bound and the fact that e = l/n c , we have that 9 < c'logn for some d = O c (l). 

Outline. The idea is to use a hash function h from a perfect hash family (Lemma 2.12) mapping 
[to] i — y [9]. The aim will now be to obtain a contribution of 1 to the sum l^(xi) from each 
bucket 4 . In order to do this, we require Yii^i be large, where \xi is the sum of pj for j in bucket 
Bi = By a reason similar to color coding (see [3]), it will turn out that this quantity is 

large when we bucket using a perfect hash family. We then prove that using a pairwise independent 
space in each bucket Bi "nearly" gives probability m of succeeding. As before, since we cannot use 
independent hashes in each bucket, we take a hash function over [n], and do an expander walk. The 
final twist is that in the expander walk, we cannot use a constant degree expander: we will have to 
use a sequence of expanders on the same vertex set with appropriate degrees (some of which can 
be super-constant, but the product will be small). This will complete the proof. We note that the 
last trick was implicitly used in the work of [12]. 

Construction. Let us formally describe a hitting set for for a fixed 6. (The final set S^jl 1 
will be a union of these for 6 < c'logn along with the hitting set of [12]). 

71 

Step 1: Let T~L p ' er f = {h : [n] — > [9]} be a perfect hash family as in Lemma 2.12. The size of the 
hash family is 2°( e )poly(n) = n° c '^ = n° c ^\ For each hash function h G T~C^ er t divide [to] into 9 
buckets B\,...,Bq (so Bi = /i _1 (i)). 

Step 2: We will plug in a pairwise independent space in each bucket. Let ise ■ {0, 1} S — > 
[m] n denote the generator of a pairwise independent space. Note that the seed-length for any bucket 
is s = 0(log n) 5 . 

Step 3: The seed for the first bucket is chosen uniformly at random and seeds for the subsequent 
buckets are chosen by a walk on expanders with varying degrees. For each i S [9] we choose every 
possible r( i such that 1/r/- is a power of 2 and Y\i Vi — ^/n° c ^ l \ where the constant implicit in the 
O c (l) will become clear in the analysis of the construction below. There are at most poly(n) such 
choices for all r^'s in total. We then take a (2 s , di, Aj)-expander Hi on vertices {0, 1} S with degree 
di = poly(l/(^?7'_ 1 )) and Aj < rj' i r]' i _ 1 / 100 (by Fact 2.9, such explicit expanders exist). Now for 
any u G {0, 1} S , {yi G [cZi]}f =1 , let (u, y\, . . . , ye) G W(i?i, . . . , Hg) be a #-step walk. For all starting 
seeds zq G {0, 1} S and all possible yi G [di], we construct the input x G [m] n s.t. for all i G [9], we 
have x\ Bi = 9T-Zise( v i( z o, W> ••• ,2/<0)k- 

Size. We have |<Sj"^ 1 \ = d log n ■ n° c ^ ■ \\ i di, where the d log n factor is due to the choice of 9, 
the n° c ^ factor is due to the size of the perfect hash family, the number of choices of (rj^, . . . , rf s ), 
and the choice of the first seed, and an additional ■ FJ^ d, factor is the number of expander 

walks. Simplifying, |«S^ 1 | = n° c Wrj di = n° c ^ Yliiv'i) ^ — n° c ^-\ where the last inequality is 
due to the choice of rj'^s. 

4 This differs from the high-weight case, where we looked at advantage over the mean. 

5 We do not use generators with different output lengths, instead we take the n-bit output of one generator and 
restrict to the entries in each bucket. 
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Analysis. We follow the outline. First, by a union bound we know that F x ^^ m j n [T^~ (x) = 1] < 
^\S\=eT\ies Pi an d hence ^2\s\=eTlieS Pi — £ - Second, if we hash the indices [n] into 6 buckets 
at random and consider one S with \S\ = 9, the probability that the indices in S are 'uniformly 
spread' (one into each bucket) is 1/2°W. By Lemma 2.12, this property is also true if we pick h 
from the explicit perfect hash family % r ^ er ^. 

Formally, given an h € Hp' er f, define ah = Hie[0] ^2j&B t Pj- Over a uniform choice of h from 
the family T-Lpf r p we can conclude that 

E fc a fc > £ Ilftp* ^ 1-1 on5]>-4> * 

\s\=eies 

Thus there must exist an h that satisfies > l/n° c<yl \ 

We fix such an h. For a bucket Bi, define r\i = F xe g^- n . EjeBj X x j) — !]• Now for 
a moment, let us analyze the construction assuming independently seeded pairwise independent 
spaces in each bucket. Then the success probability, namely the probability that every bucket Bi 
has a non-zero XljeB, ^A 3 {xj) is equal to n^i- The following claim gives a lower bound on this 
probability. 

Claim 4.9. For the function h satisfying > l/n° c<yl \ we have llie[0] ^ — l/ n ° c ^- 

Proof. For a bucket Bi, define fa = J2jeB t Pj- Further, call a bucket Bi as being good if fa < 1/2, 
otherwise call the bucket bad. For the bad buckets, 



n ^ < n eMi = ex p e ^ I - e " - n ° c[l) 

Bi bad Bi bad \Bi bad 



From the choice of h and the definition of ah we have 



n 



o—) ^ n * = n & n ^ 



Oc(l) 



n 



*6 



_Bi bad Bi good Bi good Bi good 

where we have used Equation (2) for the second inequality. 

Now let's analyze the rj^s. For a good bucket Bi, by inclusion-exclusion, 



n 



(2) 



(3) 



- E Pi ~ E PiP k - & 
jeBi j,keBi-.j<k 



(4) 



For a bad bucket, fa > 1/2. But since all pj's are < 1/2, it isn't hard to see that there must exist 
a non empty subset B[ C Bi satisfying 1/4 < := Ylj^B'Pj — V^- We now can use Equation (4) 
on the good bucket B[ to get the bound on the bad bucket Bi as follows: 



Vi > 



>^>i. 



(5) 



So finally, 



n** n i n 



> 



i i 



i 



2O(0) n o c (i) „o c (i) ■ 



i£ [6] ^ barf Bi good 

where we have used (4) and (5) for the first inequality and (3) for the second inequality. 



□ 
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If now the seeds for C/^-wise m eacn bucket are chosen according to the expander walk "cor- 
responding" to the probability vector (rji, . . . ,rjg), then by Lemma 2.10 the success probability 
becomes at least {l/2°^)Y\iVi > l/n° c{1) , using Claim 4.9 for the final inequality. 

But we are not done yet. We cannot guess the correct probability vector exactly. Instead, we 
get a closest guess (rj[, ... , rfn) such that for all i £ [9], is a power of 2 and > rji/2. Again, by 
Lemma 2.10 the success probability becomes at least (1/2°W) ]lj n[ > (1/2°W) 2 f]j % > l/n ^ 1 ), 
using Claim 4.9 for the final inequality. Note that this also tells us that it is sufficient to guess rj^ 
such that Uii 1 /^) < n°^ l \ 

4.3 The general low- weight case 

The general case (where pi are arbitrary) is more technical: here we need to do a "two level" hashing. 
The top level is by dividing into buckets, and in each bucket we get the desired "advantage" using 
a generalization of hitting sets for combinatorial rectangles (which itself uses hashing) from [12]. 
The theorem we prove for this case can be stated as follows. 

Theorem 4.10. Fix any c > 1. For any m < n c , there exists an explicit l/n c -HS C [m] n of 
size n° c ^ for functions f £ CThr(m, n) s.t. w(f) < clogra. 

Construction. We describe S,'? by demonstrating how to sample a random element x of this 
set. The number of possible random choices bounds |<S^|- We define the sampling process in 
terms of certain constants c, (i £ [5]) that depend on c in a way that will become clear later in the 
proof. Assuming this, it will be clear that |<S^| = n° c ^ . 

Step 1: Choose at random t £ {0, . . . , 15c log n}. If t = 0, then we simply output a random 
element x of S™£gz' n 1 for some constant c\. The number of choices for t is O c (logn) and if 
t = 0, the number of choices for x is n° c<yl \ The number of choices for non-zero t are bounded 
subsequently. 

Step 2: Choose h £ T~Lp' er f uniformly at random. The number of choices for h is n° c ^ ■ 2°^ = 
n o c (i)_ 

Step 3: Choose at random non-negative integers p\ , . . . , p t and ax, . . . , a t s.t. ^ pi < C2 log n 
and Y^i a i — c 3 l°g n. For any constants C2 and C3, the number of choices for px, ■ ■ ■ ,pt and ax, ■ ■ ■ , at 
is n° c W. 

Step 4: Choose a set V s.t. \V\ = ra° c(1) = N and identify V with S^' pi for some constant 
C4 > 1 and each i G [t] in some arbitrary way (we assume w.l.o.g. that the sets S^f' pt (i £ [t]) all 
have the same size). Fix a sequence of expander graphs (Gx, . . . ,Gt) with vertex set V where Gi is 
an (N, Di, Aj)-expander with Aj < 1/(10 • 2 a * • 2 a *+^) and A = 2°( a * +a *+^ (this is possible by Fact 
2.9). Choose w £ W(Gx, ■ ■ ■ , Gt) uniformly at random. For each i £ [t], the vertex Vi{w) £ V gives 
us some x^ £ S™£.f' p \ Finally, we set x £ [m] n so that x\ h -iu\ = x^\ h -iuy The total number of 

choices in this step is bounded by \W(Gx, . . . , G t )\ <N Ui D i< n ° c{1) ■ 2°^* a ^ = n°^. 
Thus, the number of random choices (and hence is at most n 0c ^\ 

Analysis. We will now prove Theorem 4.10. The analysis once again follows the outline of 
Section 4.2. 

For brevity, we will denote by S. Fix any Ai,...,A n C [m] and a threshold test / £ 
CThr(m,n) such that f{x) := T^(Y2ie[n] 1a<(^»)) f° r some 9 £ N (we can analyze combinatorial 
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thresholds / that use thresholds of the form Tq in a symmetric way). We assume that / has 
low-weight and good acceptance probability on uniformly random input: that is, w(f) < clogn 
and P xe [ m ]« [f(x) = 1] > l/n c . For each i G [n], let pi denote \Ai\/m and qi denote 1 — Pi- We 
call Ai small if pi < 1/2 and large otherwise. Let S = {i \ Ai small} and L = [n] \ S. Note that 

w (f) = EiPift > J2iesPi/ 2 + ^ieL<li/ 2 - _ 

Also, given x G [m] n , let Y(x) = ^ i6g W^i) and Z(x) = ]T\ gi l^fo). We have £V l^(xi) = 

+ (|L| — Z(x)) for any x. We would like to show that P^eS [/(x) = 1] > 0. Instead we show 
the following stronger statement: P xe ,s [Z(x) = A Y(x) > 9 — |L|] > 0. To do this, we first need 
the following simple claim. 

Claim 4.11. ¥ xe[m]n \Z(x) = A Y(x) >6 - \L\] > \ jn c \ for c x = 0(c). 

Proof. Clearly, we have F x£[m]n [Z(x) = A Y(x) >0 - \L\) = F xe[m] n [Z(x) = 0] -F xe [ m ]n [Y(x) > 9 
We lower bound each term separately by l/n°( c \ 

To bound the first term, note that P xe [ m ]n [Z(x) = 0] = n«eL(l ~~ Qi) = ex P{ — 0(^2 i&L qi)} 
where the last inequality follows from the fact that qi < 1/2 for each i € I and (1 — x) > e~ 2x 
for x G [0, 1/2]. Now, since each qi < 1/2, we have u>, < 2qi for each i G L and hence, X^ieL Qi = 
0{w{f)) = 0(c log n). The lower bound on the first term follows. 

To bound the second term, we note that P xe [ m ]n [Y(x) > 9'] can only decrease as 9' increases. 
Thus, we have 



[Y(x)>e-\L\] = J2 f 1 [Y(x)>6-\L\]- P [z 

>V P [Y(x)>(6-\L\ + i)AZ{x)-i\ 



X = l\ 



j>0 



ir£[m]'' 



> l/n c 



i£[n\ 

This proves the claim. □ 

To show that F X £S [Z(x) = A Y(x) > 9 — \L\\ > 0, we define a sequence of "good" events 
whose conjunction occurs with positive probability and which together imply that Z{x) = and 
Y(x) >0-\L\. 

Event E\\ t = max{6- \L\, 0}. Since f{x) = ^-Ai( x i)) accepts a uniformly random x with 

probability at least l/n c , we have by Chernoff bounds, we must have 6 — E x [Yli l^(xj)] < 10c log n. 
Since E^f^ l^.(xi)] < ^2 ie gPi + SieL^* — 2w (f) + l-^l> we see that 9— \L\ < 12clog n and hence, 
there is some choice of t in Step 1 so that E\ occurs. We condition on this choice of t. Note that 
by Claim 4.11, we have P xe [ m ]n [Z(x) = A Y(x) > t] > l/n Cl . If t = 0, then the condition that 
Y(x) > t is trivial and hence the above event reduces to Z{x) = 0, which is just a combinatorial 
rectangle and hence, there is an x G S L £^ Z with f{x) = 1 and we are done. Therefore, for the 
rest of the proof we assume that t > 1. 

Event £2: Given h G Hp' er .f, define ah to be the quantity Ylielt] \ Ylj&h- 1 (i)r\sPj) • Note that by 
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Lemma 2.12, for large enough constant depending on c, we have 

E [a h ]> V T[ Pj F [his 1-1 on T\ 

nizn P erf TCS:\T\=tj£T 

TCS:\T\=tj&T 

1 

— 20(t) ^ — un i° n bound) 

1 

Event £"2 is simply that > l/n c 'i . By averaging, there is such a choice of h. Fix such a choice. 

Event £3: We say that this event occurs if for each i G [t], we have pi = \Y^jeh- l (i)nsP3 + 
Sfcefc-i(i)n£ "t" ^" ^° see t na t this event can occur, we only need to verify that for this choice 
of pi, we have YliPi — C2logn for a suitable constant C2 depending on c. But this straightaway 
follows from the fact that YljesPi + SfceL Qk < 2to(/) < 2c log n. Fix this choice of (i G [i]). 

To show that there is an x 6 5 s.t. Z(cc) = and Y(x) > t, our aim is to show that there is an 

x G S with Zi(x) := J2jeh-Hi)nL l A~( x j) = and Y i( x ) : = EjeA-i(i)nS 1 A j (x j ) > 1 for each i G [t]. 
To show that this occurs, we first need the following claim. 

Claim 4.12. Fixi G [t]. Letp\ = F xeS »g.Pi [Zi(x) = A Y^x) > l] . Then, p\ > CE jeh -i {i)nS Pj)/ 2 ^ Pi 
for large enough constants C4 and c' 4 depending on c. 

Proof of Claim 4-12. We assume that pj > for every j G /i _1 (j)n5 (the other j do not contribute 
anything to the right hand side of the inequality above). 

The claim follows from the fact that the event Z{(x) = A Yi(x) > 1 is implied by any of 
the pairwise disjoint rectangles Rj(x) = 1a, fa) A Aj^fceA-^nS h^fa) A /\e<=h-i(i)nL l A e {xi>) for 
j G h~ l (i) n S. Thus, we have 

Pi= l]> Y, X 4 ^ [ ^ (X) = 1] (6) 

x ^red jeA-i(i)ns ,a:e rec * 

However, by our choice of pi, we know that pi > ^'efe- 1 (i)n5 Pj + S*eA- 1 (i)nS Ik + 1) which is at 
least the sum of the rejecting probabilities of each combinatorial rectangle Rj above. Moreover, 
Pi — SsGft] Pi — c 2logn. Below, we choose C4 > C2 and so we have pi < C4logn. 
Note also that for each j G h~ l (i) n S, we have 

Pj-= JJ R jfa = 1 ] 

>pj n (i-po n (i-ft) 

fce/i- 1 (i)ns' feA-^OrU 
> Pi exp{-2(^p fc + ^ > pj exp{-2/)j} 

where the second inequality follows from the fact that (1 — x) > e~ 2x for any x G [0, 1/2]. In 
particular, for large enough constant C4 > C2, we see that Pj > 1/m ■ l/n°^ > l/n C4 . 



15 



Thus, by Theorem 2.6, we have for each j, ^ xeS n ' c 4.'Pi [Rj(x) = 1] > Pj/2° c ^; since Pj > 
Pj /2°(Pi), we have F xeS "Wi [Rj(x) = 1] > p i /2( 0c ( 1 ) +0 ( 1 ))^ > Pj /2 C '^ for a large enough constant 
c' 4 depending on c. This bound, together with (6), proves the claim. □ 

The above claim immediately shows that if we plug in independent chosen at random from 
•Srect' Pl m the indices in then the probability that we pick an x such that Z(x) = and 

Y(x) > t is at least 

nft>i/2° c(E ^ ft) n( e 

i ie[t] jeh- l (%)r\S 

= 1 / 2 O c (logn) . afo > l/ n Oc(l) ( 7 ) 

However, the we actually choose are not independent but picked according to a random 
walk w £ W(Gi, . . . , Gf). But by Lemma 2.10, we see that for this event to occur with positive 
probability, it suffices to have Aj < p^-^/lO for each i € [t\. To satisfy this, it suffices to have 
l/2 ai < p'i < l/2 CLi ~ 1 for each i. This is exactly the definition of the event £4. 

Event £4: For each i £ [t], we have l/2 ai < p\ < l/2 cii ~ 1 . For this to occur with positive 
probability, we only need to check that Sie[t] R°§(VPi)l — c 3l°g n f° r large enough constant C3. 
But from (7), we have 

£>g(i/ P oi < feMVpJn +t 

< O c (log n) + 0(c log n) < C3 logn 

for large enough constant C3 depending on c. This shows that £4 occurs with positive probability 
and concludes the analysis. 

Proof of Theorem 4.1. The theorem follows easily from Theorems 4.3 and 4.10. Fix constant 
c > 1 s.t. m,l/e < n c . For C > a constant depending on c, we obtain hitting sets for thresholds 
of weight at least Clogn from Theorem 4.3 and for thresholds of weight at most Clogra from 
Theorem 4.10. Their union is an e-HS for all of CThr(m,ra). 

5 Stronger Hitting sets for Combinatorial Rectangles 

As mentioned in the introduction, [12] give e-hitting set constructions for combinatorial rectangles, 
even for e = l/poly(n). However in our applications, we require something slightly stronger - in 
particular, we need a set S s.t. F Xr ^s(x in the rectangle) > e (roughly speaking). We however need 
to fool only special kinds of rectangles, given by the two conditions in the following theorem. 

Theorem 5.1 (Theorem 2.6 restated). For all constants c > 0, m = n c , and p < clogn, for any 
1Z £ CRect(m,n) which satisfies the properties: 

1. 1Z is defined by A4, and the rejecting probabilities qi satisfy YliQi — 9 an d 

2. p:=F x „ [m]n [K(x) = 1] > l/n c , 
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there is an explicit set S™£f of size n° c ^ that satisfies F xr ^ s n,c,p[TZ(x) = 1] > p/2° c ( p \ 

To outline the construction, we keep in mind a rectangle 1Z (though we will not use it, of course) 
defined by sets Aj, and write pi = \Ai\/m, qi = 1 — p%. W.l.o.g., we assume that p > 10. The 
outline of the construction is as follows: 

1. We guess an integer r < p/10 (supposed to be an estimate for ^ Qj/10). 

2. Then we use a fractional hash family T~Cl' rac to map the indices into r buckets. This ensures 
that each bucket has roughly a constant weight. 

3. In each bucket, we show that taking 0(l)-wise independent spaces (Fact 2.7) ensures a success 
probability (i.e. the probability of being inside 1Z) depending on the weight of the bucket. 

4. We then combine the distributions for different buckets using expander walks (this step has 
to be done with more care now, since the probabilities are different across buckets). 

Steps (1) and (2) are simple: we try all choices of r, and the 'right' one for the hashing in step (2) 
to work is r = ^ %/10; the probability that we make this correct guess is at least l//)> 1/2 P . In 
this case, by the fractional hashing lemma, we obtain a hash family Hj' rac , which has the property 
that for an h drawn from it, we have 



Qj S [1/100,100] for all i 

jeh-^i) 

Step (3) is crucial, and we prove the following: 



1 1 



2 O c (r) - 2 Oc(p) 



Claim 5.2. There is an absolute constant a £ N s.t. the following holds. Let A\, . . . , A^ be 
the accepting sets of a combinatorial rectangle 1Z in CRect(m, k), and let qi,...,qk be rejecting 
probabilities as defined earlier, with Ylili — C , for some constant C > 1. Suppose — Qi) = n ' 
for some tt > 0. Let S be the support of an aC-wise independent distribution on [m] n (in the sense 
of Fact 2.7). Then 

FMx) = !]>!• 

Proof. We observe that if ^ qi < C, then at most 2C of the qi are > 1/2. Let B (for 'big') denote 
the set of such indices. Now consider 5, an aC-wise independent distribution over [m] n . Let us 
restrict to the vectors in the distribution for which the coordinates corresponding to B are in the 
rectangle R. Because the family is aC-wise independent, the number of such vectors is precisely a 

factor HieS^ — Qi) °^ ^ e su PP or t of S. 

Now, even after fixing the values at the locations indexed by B, the chosen vectors still form 
a (a — 2)C-wise independent distribution. Thus by Theorem 2.8, we have that the distribution 
^-approximates, i.e., maintains the probability of any event (in particular the event that we are in 
the rectangle K) to an additive error of 5 = 2~ n ^ 2 ^ < (l/2)e~ 2 ^ 91 < (1/2) \[^ B {1 - q t ) for 
large enough a (In the last step, we used the fact that if x < 1/2, then (1 — x) > e~ 2x ). Thus if 
we restrict to coordinates outside B, we have that the probability that these indices are 'accepting' 
for TZ is at least (1/2) W^qPi (because we have a very good additive approximation). 

Combining the two, we get that the overall accepting probability is ^, finishing the proof of the 
claim. □ 
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Let us now see how the claim fits into the argument. Let B±, . . . , B r be the sets of indices of 
the buckets obtained in Step (2). Claim 5.2 now implies that if we pick an oC-wise independent 
family on all the n positions (call this S), the probability that we obtain a rectangle on Bi is at 
least (1/2) rijeBi (1 ~~ Qj)- For convenience, let us write Pj = (1/2) nje_B 4 (l ~~ We wish to use an 
expander walk argument as before - however this time the probabilities Pi of success are different 
across the buckets. 

The idea is to estimate Pi for each i, up to a sufficiently small error. Let us define L = [clogn] 
(where p is as in the statement of Theorem 2.6). Note that L > log(l/p), since p > l/n c . Now, we 
estimate log(l/Pj) by the smallest integer multiple of L' := [L/r\ > 10 which is larger than it: call 
it oti ■ L' . Since Yli l°g(l/-Pi) * s a ^ m ost L, we have ^ c^L' < 2L, or Yli a i < 3r. Since the sum is 
over r indices, there are at most 2°^ choices for the a, we need to consider. Each choice of the 
aj's gives an estimate for Pi (which is also a lower bound on Pi). More formally, set pi = e~ a * L , so 
we have Pi > pi for all i. 

Finally, let us construct graphs Gi (for 1 < i < r) with the vertex set being S (the aC-wise 
independent family), and Gi having a degree depending on pi (we do this for each choice of the p^s). 
By the expander walk lemma 2.10, we obtain an overall probability of success of at least Y\ i Pi/2°^ 
for the "right" choice of the p^s. Since our choice is right with probability at least 2~°( r \ we 
obtain a success probability in Steps (3) and (4) of at least Ui P i/ 2 ° {r) > p/2° (r) > p/2°W. In 
combination with the success probability of l/2° c ^^ above for Steps (1) and (2), this gives us the 
claimed overall success probability. 

Finally, we note that the total seed length we have used in the process is O c (logn+^ i log(l/pi)), 
which can be upper bounded by O c (logn + L) = O c (logn). 



6 Constructing a Fractional Perfect Hash family 

The first step in all of our constructions has been hashing into a smaller number of buckets. To 
this effect, we need an explicit construction of hash families which have several "good" properties. 
In particular, we will prove the following lemma in this section. 

Lemma 6.1 (Fractional Perfect Hash Lemma: Lemma 2.13 restated). For any n,t £ N such that 
t < n, there is an explicit family of hash functions T~L n ^ ac Q [t]^ of size 

2 o(t) n o(i) such that f or 

any z £ [0, l] n such that Y^jeln] z i — we ^ ave 



hen 



frac 



> 



2°(*) 



Proof. For S C [n], we define z(S) to be Y^jes z j- By assumption, we have z([n\) > Wt. Without 
loss of generality, we assume that z([ra]) = Wt (otherwise, we work with z = (Wt/ z([n]))z which 
satisfies this property; since we prove the lemma for z, it is true for z as well). We thus need to 



construct 7^^'* such that 

j 7 ac 



heH 



P [Vi G [t], zQi" 1 (i)) G [0.1,100]] 



> 



frac 



2°W 



for some constant Cf rac > 0. 
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We describe the formal construction by describing how to sample a random element h of 1-Cl'. 

j vac 

To sample a random h G T~i n f rac -, we do the following: 

Step 1 (Top-level hashing): We choose a pairwise independent hash function h\ : [n] —> [Wt] by 
choosing a random seed to generator G^-wise- By Fact 2.7, this requires 0(logra + logi) = O(logn) 
bits. 

Step 2 (Guessing bucket sizes): We choose at random a subset I' C [lOi] of size exactly t and 
yi, . . . ,y\ot G N so that X^yi — 30t. It can be checked that the number of possibilities for I' and 
yi,...,yiot is only 2°®. 

Step 3 (Second-level hashing): By Fact 2.7, for each i G [lOt] , we have an explicit pairwise 
independent family of hash functions mapping [n] to [yi] given by G^-wise- We assume w.l.o.g. 
that each such generator has some fixed seedlength s = O(logn) (if not, increase the seedlength of 
each to the maximum seedlength among them). Let V = {0, 1} S . Using Fact 2.9, fix a sequence 
(G*i, . . . , Giot) of lOt many (2 s , D, A)-expanders on set V with D = 0(1) and A < 1/100. Choosing 
w G W(Gi, . . . , Giot) uniformly at random, set h 2: i : [n] — >• [yj] to be G2- T wise( v i( w )) • Define, 
h,2 ■ [n] — > [30t] as follows: 

^(i) = J] yi + /l 2,/ ll (j)(j) 

\i</ii(j).*^' / 

Given the random choices made in the previous steps, the function hi is completely determined by 
|W(Gi,...,Giot)|, which is 2°(*>. 

Step 4 (Folding): This step is completely deterministic given the random choices made in the 
previous steps. We fix an arbitrary map / : (I' x {0}) U ([30i] x {1}) — > [t] with the following 
properties: (a) / is 1-1 on /' x {0}, (b) / is 30-to-l on [30t] x {1}. We now define h : [n] -> [t]. 
Define h(j) as 

/(^(j),o) if^OOei', 

/(^2,hi(j)0'),l) otherwise. 

It is easy to check that |^^* ac |, which is the number of possibilities for the random choices made 
in the above steps, is bounded by 2°^n°( 1 \ exactly as required. 

We now show that a random h G W*?' „ has the properties stated in the lemma. Assume h is 
sampled as above. We analyze the construction step-by-step. First, we recall the following easy 
consequence of the Paley-Zygmund inequality: 

Fact 6.2. For any non-negative random variable Z we have 

P[Z>0.1E[Z]]>0.9^j^-. 

Consider hi sampled in the first step. Define, for each i G [30i], the random variables Xi = 

z(h^(i)) and Yi = T, n ^ J2 -.h 1 ( h )=h 1 (j2)=i z h z h^ and let X = J2ie[iot] X f and Y = J2 ie [iot] Y i- An 
easy calculation shows that X = zf + Y < lOt + Y . Hence, E^ 1 [X] < Wt + E/ ll [Y] and moreover 



Kj) 



E[Y] = ^ z n z n P [h!(ji) = < z([n]) 2 /10t = Wt 

hi f-r. h-i 



Let E\ denote the event that Y < 20t. By Markov's inequality, this happens with probability at 
least 1/2. We condition on any choice of hi so that £i occurs. Note that in this case, we have 
X < 10t + Y < 30t. 
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Let Z = X j for a randomly chosen i G [10t]. Clearly, we have Ej[Z] = (l/10t)^ i Xj = 1 and 
also Ei[Z 2 ] = (l/10i)X^X? = (l/10t)X < 3. Thus, Fact 6.2 implies that for random i G [n], 
we have P, ; [Z > 0.1] > 0.3. Markov's Inequality tells us that P; [Z > 10] < 0.1. Putting things 
together, we see that if we set I = {i G [n] \ Xj_ G [0.1, 10]}, then |/| > 0.2 x lOt = 2t. We call the 
i G I the medium-sized buckets. 

We now analyze the second step. We say that event £2 holds if (a) I' contains only medium- 
sized buckets, and (b) for each i G [t], yi = \Yi\. Since the number of random choices in Step 2 is 
only 2°^ and there are more than t many medium-sized buckets, it is clear that P [£2] > l/2 0<yt \ 
We now condition on random choices in Step 2 so that both £\ and £2 occur. 

For the third step, given i G" we say that hash function /i2,i is collision-free if for each 
k G [yi], we have z(Si y k) < 2 where 5^ = h^lik) n The following simple claim shows that 

this condition is implied by the condition that for each k, Y^k := ^j 1 ^j 2 eS' k z h z h — 2- 

Claim 6.3. For any a%, . . . , a m G [0, 1], if J2j a j > 2, then J2j 1 ^j 2 a h a h > 2- 

For the sake of analysis, assume first that the hash functions /i2,i (i G [10t]) are chosen to be 
pairwise independent and independent of each other. Now fix any i G [lOt] and k G [yi]. Then, 
since /i2,i is chosen to be pairwise-independent, we have 

E[Yi,k] = V z n z n P [h 2 i{h) = husfo) =k] = Y./yf < 1/ Vi 

h2 i 

jl¥=j2-h2,z(jl)=h 2 ,t(j2)=i 

In particular, by Markov's inequality, P \Yi k > 2] < l/2yj. Thus, by a union bound over k, we see 
that the probability that a uniformly random pairwise independent hash function h2 t i is collision- 
free is at least 1/2. 

Now, let us consider the hash functions /i2,i as defined in the above construction. Let £3 denote 
the event that for each i g" is collision-free. Hence, by Lemma 2.10, we see that 

P [£ 3 ] = P [Vi G [lOt] \I' : h 2i collision-free] > l/2° w 

weW(Gi,...,G wt ) 

Thus, we have established that P [£ x A £ 2 A £3] > l/2 0{t \ We now see that when these events 
occur, then the sampled h satisfies the properties we need. Fix such an h and consider i G [t]. 

Since / is a bijection on I' x {0}, we see that there must be an i! G V s.t. f(i') = i. Since i! G V 
and the event £2 occurs, it follows that i! is a medium-sized bucket. Thus, > z(h^ l (i')) > 

0.1. Secondly, since £3 occurs, we have 

z{h- 1 (i)) = z{h^ l (i'))+ V z{h 2 l (i) \h^ 1 (/'))< 10 + 30 max 2(5 ifc )<100 

where the final inequality follows because £3 holds. This shows that for each i, we have G 
[0.1, 100] and hence h satisfies the required properties. This concludes the proof of the lemma. □ 

7 Open Problems. 

We have used a two-level hashing procedure to construct hitting sets for combinatorial thresholds 
of low weight. It would be nice to obtain a simpler construction avoiding the use of an 'inner' 
hitting set construction. 
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It would also be nice to extend our methods to weighted variants of combinatorial shapes: 
functions which accept an input x iff J2i a i^-Ai(xi) = S where 014 6 M>o- The difficulty here is 
that having hitting sets for this sum being > S and < S do not imply a hitting set for '= S\ The 
simplest open case here is m = 2 and all A{ being {l}. 6 However, it would also be interesting to 
prove formally that such weighted versions can capture much stronger computational classes. 
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A Proof of the Expander Walk Lemma 

In this section we prove Lemma 2.10. For convenience we restate it below. 

Lemma A.l (Lemma 2.10 restated). Let G\, . . . , Ge be a sequence of graphs defined on the same 
vertex set V of size N . Assume that Gi is an (N, D{, \i)-expander. Let V\, . . . , Vi C V s.t. \Vi\ > 
PiN > for each i £ [£]. Then, as long as for each i £ [£}, Aj < (piPi-i)/8, 

P ^ Nie[e\M«>)eVi\> (0.75? (8) 

Without loss of generality, we can assume that each subset Vi (i G [£]) has size exactly PiN. 
Let us consider an £ step random walk starting at a uniformly random starting vertex in [N], 
in which step i is taken in the graph Gi. The probability distribution after £ steps is now given by 
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A\A% ■ ■ ■ AiIn, where ljv denotes the vector (l/N, . . . , 1/N), and A4 is the normalized adjacency 
matrix of the graph Gj. 

Now, we are interested in the probability that a walk satisfies the property that its ith vertex 
is in set Vi for each i. For £ = 1, for example, this is precisely the L\ weight of the set V\, in the 
vector Ailjy. More generally, suppose we define the operator Is to be one which takes a vector 
and returns the "restriction" to S (and puts zero everywhere else), we can write the probability as 
||Jvi^4i1aHIi- in general, it is easy to see that we can write the probability that the ith vertex in 
the walk is in Vi for all 1 < i < t is precisely \\Iy t AtIy t _ 1 At-.\ . . . Iy 1 Ai\\i. We will call the vector of 
interest uu\, for convenience, and bound H^mHi inductively. 

Intuitively, the idea will be to show that um should be a vector with a 'reasonable mass', and 
is distributed 'roughly uniformly' on the set Vt. Formally, we will show the following inductive 
statement. Define ur \ = lj\r- 

Lemma A. 2. For all 1 < t < I, we have the following two conditions 

11 11 ^ 3 P* 11 11 m\ 
\\u(t) ||i > -^-\\u(t- 1)|| 1 (9) 



H)h<^\\Ht)h (10) 



Note that the second equation informally says that the mass of um is distributed roughly equally 
on a set of size ptN. The proof is by induction, but we will need a bit of simple notation before 
we start. Let us define n" and u 1 - to be the components of a vector u which are parallel and 
perpendicular (respectively) to the vector ljv- Thus we have u = w + for all u. The following 
lemma is easy to see. 

Claim A. 3. For any N -dimensional vector x with all positive entries, we have ||x"||i = ||x||i. 
Furthermore, a;ll is an N -dimensional vector with each entry \\x\\i/N. 

Proof. The "furthermore" part is by the definition of sell, and the first part follows directly from 
it. □ 

We can now prove Lemma A. 2. We will use the fact that Ajl^r = ljy for each i, and that 
ll-^i^lb < 'MMh for u orthogonal to ljv- 

Proof of Lemma A. 2. For t = 1, we have un\ = IyiAilw = I^ljv, and thus we have ||«(i)||i = Pi, 
and we have ||it(i)||2 = J^ lN 1 an d thus the claims are true for t = 1. Now suppose t > 2, and that 
they are true for t — 1. 

For the first part, we observe that 

IKi)lli = ll J y t ^(i-l)lll > l|-^Vi^LiW(t_i)||l - 11^^*^-1)111 (11) 

The first term is equal to ||/y t 'iil t _ 1 J|i = Pt||«(t-i) ||i, because ly t preserves ptN indices, and each 
has a contribution of ||u(t_i) \\i/N, by Claim A.3. 
The second term can be upper bounded as 



\\IvtMuf t _ t) \\i < VNWlvtAtuf^y < VN ■ \ t \\u( t _i)\\ 2 < ^ ^ ||u( f _i)||i, 
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where we used the inductive hypothesis in the last step. From the condition At < ptPt-i/8, we 
have that the term above is bounded above by Pt\\u^t-i) ||i/4. Combining this with Eq.(ll), the 
first inequality follows. 

The second inequality is proved similarly. Note that for this part we can even assume the first 
inequality for t, i.e., ||it(t)||i > (3/4)pt ||i- We will call this (*). 

||«(t)||2 < ||A4^t«( t _i)ll2 + \\IvtAtuft_yh (12) 

The first term is the £2 norm of a vector with support Vt, and each entry ||tt/ t _i\ ||i/iV, from 
Claim A.3 we have that the first term is equal to ^y 111 • y/p^N < (4/3) • V*^ 1 , with the 
inequality following from (*). 

The second term can be bounded by 

x ^ u (^ - ' l|n(t - 1)l ' 1 - wm Ht)h - 

Here we first used the inductive hypothesis, and then used (*), along with our choice of A^. Plugging 
these into Eq. (12), we obtain the second inequality. 

This completes the inductive proof of the two inequalities. □ 
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